
amies Generated by a Combination of 
Graphs 



Vasileios Basics^, Gian-Luigi Forti^'^ and Gregoire Nicolis^ 
February 2, 2008 

Interdisciplinary Center for Nonlinear Phenomena and Complex Systems, 
CP. 231, Universite Libre de Bruxelles, B-1050 Brussels, Belgium. 
Contact: vbasios@ulb.ac.be, gnicolis@ulb.ac.be 

^ Dipartimento di Matematica, Universita degli Studi di Milano, 
via C. Saldini 50, 1-20133, Milano, Italy. Contact: forti@mat.uninii.it 



In this paper we investigate the growth rate of the number of all 
possible paths in graphs with respect to their length in an exact ana- 
lytical way. Apart from the typical rates of growth, i.e. exponential or 
polynomial, we identify conditions for a stretched exponential type of 
growth. This is made possible by combining two or more graphs over 
the same alphabet, in order to obtain a discrete dynamical system gen- 
erated by a triangular map, which can also be interpreted as a discrete 
non-autonomous system. Since the vertices and the edges of a graph 
usually are used to depict the states and transitions between states of 
a discrete dynamical system, the combination of two (or more) graphs 
can be interpreted as the driving, or perturbation, of one system by 
another. 
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1 Introduction. 

Strings consisting of sequences of symbols play a central role in many natural 
phenomena. For instance, the DNA and RNA are linear strings carrying 
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the genetic code written in an alphabet consisting of four letters A, C, G 
and T (or U) according to whether the nucleotide subunit contains the base 
adenine, cytosine, guanine and thymine (or uracil). Furthermore most of the 
communication processes generating and transporting information or having 
a cognitive dimension such as computer programs, the electrical activity 
of the brain, texts or music, are implemented in one way or the other in 
symbolic terms. 

With the advent of nonlinear dynamics and in particular chaos theory, it 
has been realized that the evolution of large classes of dynamical systems can 
be also described, under certain conditions, by a sequence of symbols. The 
existence of such a symbolic dynamics related, in addition, to the principal 
indicators of the complexity of the underlying system, provides a unique 
opportunity to understand the mathematical and physical mechanisms at 
the basis of information generation and transduction. In this context, a 
central question is how to enumerate and to characterize the full set of 
possible sequences generated by a dynamical system or, in a more dynamic 
language, the paths leading from one state to another. 

A variety of approaches to this major problem have been reported, but 
several aspects remain only partially understood. A measure of the depen- 
dence of the number of sequences of a given length (to which we will refer 
hereafter as words) with respect to the length is the block entropy, defined 
by 

H{n) = P[w{n)] In {P[w{n)]) (1) 

w{n) 

where the summation is over all allowed words w^n) of length n and i-*[tt;(n)] 
is the associated probability (a word is allowed if it represents a possible 
path leading from one state to another; in general not all conceivable paths 
are possible for the system under investigation). Note that for uniformly 
distributed probability, H{n) is exactly the logarithm of the number of words 
of length n. For sequences generated by Bernoulli or Markov processes the 
Shannon-McMillan theorem [Applebaum, 1996 asserts that 



P[w{n)] ^ e-^(") = e-'''' (2) 

where h, the entropy of the source, is a discrete analog of the Kolmogorov- 
Sinai entropy. This entails that (a) H{n) scales linearly with the word 
length and (b) that long words are extremely improbable, as they are ex- 
ponentially penalized. The penalization is maximal for a Bernoulli proces- 
sor where h takes its largest value for a given alphabet [Applebaum, 1996 , 
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[Kitchens, 1998| . Although still exponential, it is milder for a Markov pro- 
cessor since h is in this case less than the maximum. As it turns out holds 
true for sequences generated by chaotic dynamical systems as well in the do- 
main of fully developed chaos [Gaspard, 1998| , [Nicolis, 1995| , [Hao, 1990] . 

In many real world systems we do not observe exponential rates of 
growth. This means that there exists a procedure of selection of a subset of 
sequences possessing some prescribed properties out of the total number of 
sequences. In this context Ebeling and Nicolis [1992] proposed the following 
generic scaling law for the block entropy 

H{n) = nh + gn'' (lognY + e, /i > 0, < /i< 1, i/ < (3) 

and showed that classical literature texts or music obey to Eq.([3|) with h = 
0, = and /x < 1. Dynamical systems showing weak chaos in the form 
of intermittency, and sporadic systems have also been shown to give rise to 
a sublinear scaling of H{n), [Gaspard, 1998 , Nicolis, 1995 . The question 



has therefore been raised, under what conditions could the block entropy 
of a dynamical system scale sublinearly with n, thereby rendering possible 
the selection of long sequences with a non-negligible probability. Obviously 
one can think of a number of constraints external to the dynamics (for 
instance, the meaning of a string of letters in a natural language). A natural 
and interesting problem concerns the possibility of constructing a dynamical 
system including in itself a selection rule capable of producing a sublinear 
scale. Our principal goal in this paper is to propose the construction of 
higher dimensional dynamical systems obtained by suitable combinations of 
simple systems, each of them generated by a single graph. 

The idea of our construction comes from the theory of two- variable trian- 
gular maps, i.e., maps where the first component depends only on the first 
variable. In our particular case, actually, the system generated by these 
triangular maps can also be interpreted as a non- autonomous discrete dy- 
namical system. We are able to show that this mechanism can generate a 
subclass of scalings of the form of Eq.([3]), leading at the level of Eq.([2]) to a 
stretched exponential dependence of P[w{n)] on n. 

To the degree that the states of a system can be encoded via a reason- 
ably small finite alphabet and as long as the alphabet remains constant, it 
is natural to identify the states of the system as vertices of a graph and 
the edge between two vertices as a transition between these two states. 
The connectivity of a graph reflects, then, the possible transitions between 
states, and a path traversing through the vertices of the graph describes a 
possible trajectory of the system. In the present work we shall adopt this 
representation. 
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In this representation the upper bound of the block entropy (see Eq.([T|)) 
computed over all possible Markov measures [Gaspard, 1998| gives the topo- 
logical entropy of the system, which indicates what paths are possible to be 
realized 'in principle' independently of any probabilistic consideration. 

More technically, [Douglas &: Markus, 1995| , [Kitchens, 1998] , the topo- 
logical (block) entropy of a sequence X (or "the entropy of the shift X", if 
the sequence comes from a shift) is defined as 

htop= lim ( -log2 |-B„(X)| ) 
n~*oo yn J 

where |-B„(X)| is the number of n-blocks appearing in X. Obviously, since all 
the blocks counted cannot be more than all the combinations of the letters 
of the alphabet at hand, \Bn{X)\ = |^|^'" < l^dl". where \A\ is the cardinal 
number of the set of letters A which constitute the alphabet in use. Usually 
the parameter c is called entropy's "growth rate". In this formulation the 
analogue of Eq.Q would be the presence of a more intricate relationship, 
e.g. in the form \Bn{X)\ = |^|^("). 

In Sect 121 we review some results for the number of symbol sequences 
obtained by following all paths over a graph. Then in SectlHl we investigate 
the possibility of deviating from this standard symbol sequence generation 
by combination of graphs which correspond to a kind of perturbation of the 
original dynamical system. We report two examples which give a stretched 
exponential growth rate for the resulting symbol sequences. We conclude 
in Sectm by an overview of the results and an outlook of further possible 
developments. 

2 Symbolic Dynamics of a single graph 

In all generality, the technique of associating a dynamical system to a 
symbol-sequence producing system consists of applying a suitable partition 
of the phase space of the system (coarse graining) to a finite number of cells 
[Nicolis, 1995| , [Douglas &: Markus, 1995| and then to associate the cells of 
the partition to the letters of an alphabet. A trajectory of the system pro- 
duces then a symbol sequence as it visits the different cells of the partition. 
Relevant partitioning of the phase space reflects the ability of recording 
relevant features of the dynamics. 

A key point in the foregoing is to associate a directed graph G over 
the alphabet of the (coarse grained) states with the transitions from each 
state to another. The adjancency matrix, M, of the graph G has elements 
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rriij = 1 if the transition from state i ^ j is possible and rriij = other- 
wise. Providing, in addition, a Markov measure over the states will give the 
transition probability matrix of the system. 

Evidently all information about the possible transitions is encoded in the 
adjancency matrix of the graph and the growth of the block entropy of the 
resulting symbol sequences will be given by the first eigenvalue of M. Any 
path of transitions associated to a succession of states can be envisioned as 
a path on the graph G. We shall be interested here in the characterization 
of possible transitions, and therefore restrict this work on simple connected 
graphs associated with dynamical systems, leaving the graphs equipped with 
a Markov measure for later work. In order to proceed some definitions and 
a review of known results arc necessary. 

Let us consider an alphabet A = {Xi,X2, • • • ,Xk} and denote by Ak 
the set of all finite words generated by ^. By A^ we denote the set of all 
words of length n, so we have 

A = U^i^^. 

Let G be a connected directed graph (from now on all graphs here 
considered are connected and directed) having A as set of vertices and with 
at most two edges with different directions connecting two vertices; thus, 
there is at most one arrow from a vertex Xi to another vertex Xj. Given a 
word s G Ak, a 1-letter extension of s generated by G is defined as follows: 
if Xi is the last letter of ,s, wc add a letter Xj if and only if the graph G as 
an arrow from X^ to Xj. Depending on the number of arrows in G starting 
from Xi we have the same number of 1— letter extensions of s. 

As a first step we formulate the generation of words by a graph in terms 
of a discrete dynamical system, i.e., the iterated application of a suitably 
defined function over a certain set. To do this, we define a map Q from the 
family 2'^'= of all subset of Ak into itself in the following way: 

for S C Ak, G{S) is the set of all 1-letter extensions of the words in S, 
generated by G. 

The set G"'~^{A) {Q^~^ is the n — 1-iterate of Q) is the set of the words 
of length n generated by G. In the following we will denote this set by Wq 
and by Wq the set of all finite words generated by G or admissible words. 
Here, by an admissible word we mean a finite string constructed with the 
alphabet {Xi,X2,- ■ ■ ,Xk} such that if a pair XiXj appears in the string, 
then G has an arrow from Xi to Xj. 

With the symbol }VQ{Xi, Xj) we denote the set of admissible words of 
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length n starting with Xi and ending with Xj. Moreover, we set 

=u,tiWS(x„x,), w^i;Xj)=ul,w^ix„Xj). 



The following theorem is well known [Douglas &: Markus, 1995 |: 



Theorem 1 Let ^ = [m^^ be the (n — l)-th power of the adja- 



cency matrix M . 

The cardinality ujQ{Xi,Xj), that is the number of words in WQ{Xi,Xj), 
is then 

u;2;iX,,X,)=m^-'^ 



and 

k 



Next we can state a theorem which provides a linear difference equation 



for uJq. 



Theorem 2 Let Pm{^) = + X]r=o cLrX^ be the characteristic polyno- 
mial of M (Pm{X) = det{\I — M) ). Then, for every n > k, we have 



fc-i 

r=0 



Proof- Since any matrix is a root of its characteristic polynomial, we 
have 

k-l 



r=0 

Multiplying both sides by M"~'^~^ we get 

fc-i 



rn—k+r—l 

r=Q 



Thus, we immediately have 

u;S = - 5] aru;2r'+' (4) 



k-l 



r=0 



QED. 
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As an obvious consequence of Theorem 2 we obtain the following corol- 
lary: 

Corollary 3 Assume that ^i, • ■ ■ ^ fJ-s o,re the non zero distinct roots of 
the characteristic polynomial of M, with respective multiplicities ri, - ■ ■ ,rs. 



where the coefficients cq and c^q are determined by the values uJq for 
p = !,■■■ ,k. 

We remark that not only ojq satisfies the previous difference equation 
but also iOQ{Xi, Xj), for every i, j = 1, • • • ,k. 

We conclude this section by highlighting an important consequence stem- 
ming from Corollary 3. Let us define p = maxK(//j), then the rate of growth 
of ujq with respect to the length n of the words can only have one of the 
following three forms: 

(i) exponential, iVq ~ p^, if /? > 1, 

(ii) polynomial, u)q ~ p{n), with p{n) a polynomial with deg{p{n) ^ 1 , if 
p = 1 or with deg{p{n)) = if p = 

(iii) a combination of polynomials and exponentials, uJq ~ p{n)p"', if p > 1 
and its corresponding root has multiplicity greater than one. 

The graphs used in the following section are examples of case (i) and 
(ii). To get a polynomial of degree zero, it is enough to consider the graph 
on a two-letter alphabet with the following adjacency matrix M, 



To our knowledge, and according to some preliminary numerical investiga- 
tion, it seems that case (iii) cannot arise. 

The previous remark shows that there is simply no possibility for paths over 
any graph to generate symbol-sequences with stretched exponential growth 
rates, i.e., u>q ~ p"'" with < < 1. We shall see, presently, that this kind 
of growth may result from a combination of graphs. 



Then 




h=l q=l 
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3 Combination of graphs. 



Let us now turn to symbol sequences generated by a collection of graphs. 
Assume we are given (. different graphs Gi, G2, • • • , Gi on the same alpha- 
bet A = {Xi,X2, - ■ ■ j-'^fc}. We also equip this collection of graphs with 
a transition rule among them. This rule might represent, for instance, a 
'superselection' rule [Nicolis, 2005| not encoded within each graph but gov- 
erning the transition among different domains of distinct dynamics, as in 
the case of hybrid systems, see for example [Basios, 2001| and references 
therein. We shall assume that this rule is a deterministic one given by an 
increasing sequence of non negative integers, {gi}, i G N, 5(0 = 0. 
We construct on N x 2-^'= the following dynamical system: 

T{m, S) = {m + l,Qr{S)) if gu+r-i <m< gu+r, 

5) 

t = 0,l,2,--- , r = l,2,--- ,L 

This amounts to using repeatedly in sequence the graphs Gi, G2, • • • , G^, 
the duration of the use of a single graph being controlled by the given de- 
terministic sequence {gi\. 

The above construction (analogously to that presented in the previous 
section giving a dynamical description of the generation of words by a graph) 
gives a formulation in terms of a discrete dynamical system of the combi- 
nation of the graphs Gi, G2, • • • , G^ driven by the sequence {gi}. This can 
be understood as a two-variable map with the first component depending 
only on the first variable known as a triangular map. The dynamical sys- 
tem is generated by iteration of this map. Due to the fact that the first 
variable is discrete, this construction has also a natural interpretation as 
a non- autonomous dynamical system. In any case, what is important and 
is in a certain sense the goal of the present investigation, is to embed the 
transition rule into the dynamics. 

We are mainly concerned with the trajectory starting with (0, A) and, 
by denoting with pr2 the projection on the second coordinate, the set 

W^:=pr2(.F"-i(0,A)) 

will be called the set of words of length n generated by the dynamical sys- 
tem (5). In the two following subsections we shall demonstrate how non- 
standard, e.g. stretched exponentials growth rates can result by such a 
combination of graphs. First, we will give an example where both graphs 
have an absorbing state (for our purposes, an absorbing state is a vertex 
with no outcoming edges other than its own self). Secondly, we give an 
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example of a combination of a fully connected graph and a graph with an 
absorbing state. 



3.1 Combination of two graphs: An example with absorbing 
states 

The two graphs to be combined are defined over the three-letter alphabet 
{X, Y, Z} as follows. The first graph Gi has the form: 




Its adjacency matrix is 



Ml 



1 1 1 

1 

1 1 



and the corresponding characteristic polynomial is 

Pm^ = A'^ - 2A2 + 1, 

which has 1, (1 + \/5)/2 =: and (1 — \/5)/2 =: 1 — ^ as roots. 

By applying the results presented in Section 2, we obtain the following 
formulas (the subscript 1 to all w's refers to the graph Gi): 



V5 



[M"-(i-/^r] 



10 " 10 

^M'^ + ^fl 



10 



-2 + 



5 + 2^/5 



10 



(1 - 



2^5 



(1 - 



u'^{Y,X)=u^{Y,Z)=0, uUY,Y) = l 
co^Y, •) = 1 
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10 



10 



u^{Z,Y) 



uUZ, •) 



-1 + 



10 ' 10 
5 + 3^/5 „ 5-3^5 



10 



10 



(1 - t^y 



5 + a/5 „ 5 - \/5 



10 



10 



1 



u;^(.,Z) = ^K-(l-/xr] 



^ 15 + 7^/5 15- 7\/5 

The following two inequalities will be useful for further developments: 
uj'l{X,X) >uj'^{X,Z), u^x{Z,X) >u1{Z,Z). 

The second graph G2 is the following: 




Its adjacency matrix is 



Mo 



1 0' 

1 

1 1 1 



and the corresponding characteristic polynomial is 



Pm2 = ^ - 2A^ + A, 



10 



which has and 1 (with multipHcity 2) as roots. 
We obtain the following formulas: 

LO^^{X,X)=col^{X,Z)=0, Lj^iX,Y) = l 
u^{X,-) = l 

u^iY, X) = u^iY, Z) = 0, a;^(F, Y) = 1 
a;?(y,-) = l 

cj^(Z,X) = = 1, u^{Z,Y) = 2n-3 

u;^{Z,-) = 2n + 1 

X) = Z) = 1, U;^i;Y) = 2n - 1 



= 2n + 1 

Let now {gi}, i G N, (/o = 0, be a given increasing sequence of non 
negative integers. We construct on N x 2-^3 dynamical system: 



J^{m, S) 



(m + l,gi(5)) if g2t<m<g2t+i, t = 0,1,2,- ■ ■ 
(m+ 1,^2(5')) if g2t+i <m < g2t+2, t = 0,1,2,' 



and we denote by LOjr the cardinality of the set W^. Our aim is to give 
a lower and an upper bound for and then to prove that, for suitable 
choices of the sequence {gi}, we may obtain a growth given by stretched 
exponentials. 

Given two square matrices M and of the same dimension, we say that 
M < iV if this order relation is valid entry by entry. We write M < N ii 

M < N and M N. 

We denote by \M\ the sum of all entries of the matrix M. Clearly, if M < A^, 
then \M\ < \N\. Moreover, \i M < N , L < K and all entries are non 
negative, then ML < NK and \ML\ < \NK\. 

If we define st = gt — gt-i, we have the following theorem. 

Theorem 3 For every t > 1 we have 

t t 
5-*/2 H _ (1 _ ^).2.-i] < ^9^t < ^.i+.3+-+.2*-i [1 + 2 ^ S2i] (7) 

i=l i=l 
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Proof- We begin with the second inequahty. As a first step we 



that 



M^'-^M^'Ml' ■ ■ ■ * < Mfi+'^+'-'+'^'-i"^ + C{si, S2) + 

C{si + S3, S4) H h C{si + S3 H h S2t_l, S2t), 



where 



C{a,h) 



2bu1{X,Z) 0' 


2hujl{Z,Z) 



The matrices and have the following forms: 



■a;[+i(X,X) <i(X,Zy 

1 

[_u:{+\Z,X) u;{+\Z,Y) 



1 

1 

1 2r - 1 1 



The proof is by induction on t. For t = 1 we have: 



wr(x,zy 
1 + 

<(z,y) 

ujI'{X,X) + {2s2-1)uj{^{X,Z) 0' 
< 

<(Z,X) + (2s2-lX(Z,Z) 

■c^f(x,x) 

1 + 

2s2c^f(X,Z) 0] 

=Mf-VC(si,S2). 

2s2wf(Z,Z) oj 

In order to obtain the previous inequality we used inequalities ([6]). 
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Now, assume that the relation is true for t and consider t + 1: 



^^,,+,3+...+,,,_,_l ^ ^^^^^^^^ ^ _ _ _ ^ ^^^^ + ,3 + . . . + S2t-l,S2t)] X 
[Mf'+^+C(s2m + l,52t+2)]. 

(9) 

Since we have the following equations: 



C{a, b)C{c, d) = 0, C{a, b)M[ = C{a, b), 

Ml'^''^-^'''~'-^C{s2t+l + 1, S2t+2) = C{SI + S3 + . . . + S2t+1, ^st+s), 

the last term in Eq.Q becomes 

^s^,+s,+-+s,,^,-l ^ ^^^^^ S2) + --- + C{S, + SS + --- + S2t+l,S2t+2). 

Thus the inequality dS]) is proved. 
Since |C(a,6)| < 26u;f, we obtain 



, ,92t ^ , S1+S3H f-S2t-l 



+ 2sia;f H + 2s2t0Ji 



Sl+saH hS2t-l 



Since, obviously, 
for any j < t, we finally get 



si+ssH ^S2i-1 ^ Si+saH hS2t-l 



, ,92* S1+S3H l-S2t. 



i.e., the right-hand side of the above is nothing more than the right-hand 
side of Eq. ^ . The other inequality follows easily, since we have 



'ujI''{X,X) 0' 






and so 



Ml'-^M^^M[' ■ ■ ■ M|2* I > ojI' {X, X)uj1;^+\X, X) ■ ■ ■ X). 



S3 + 1/- 



S2t-1 + 1/ 
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Since > uj\{X,X), we have 

{X, X)uj'^'+\X, X)--- *-^+^ {X, X) > (X, (X, X) • • • (jf {X, 

and 

t 

(jf (X, X)L^f (X, X) • • • a;f (X, X) = 5"*/^ [| [^^^^-^ - (1 - fi)'^^-'] . 

1=1 

QED 

Now we specify the sequence {st} (or {gt}) in order to obtain the desired 
result. Choosing 

Sl = 4, S2t-1 = 2t+l, S2t = {t + if -t^ + t^-{t + if 

we have: 

51 + S3 + ---+S2t-1 = {t + lf 

52 + Si + ---+S2t = {t + lf -{t+ if 

n := g2t = Sl + S2 -\ \- S2t = {t + if. 

Substituting in Eq.© we obtain the inequalities: 

i=l 

Denoting by /i(n) and /2(ra) the left- and right-hand sides of ?? respectively, 
we obtain the following asymptotic evaluations: 

/i(n) X 5-(^-i)/V^, /2(n) X n^v^. 

At this point it is worthwhile to specify the role of the absorbing states 
in the graphs Gi and G2- In both graphs the absorbing state if given 
by Y and the consequence of this is that a;"(y, •) = WgC^r) = 1; while 
a;f(.,y) = -2+5^^/x" + ^^^(l-^)" andu;^(-,y) = 2n-l. This implies 
that when passing from one graph to the other the quite large number of 
words ending by Y in not changed along the application of the new graph. 
The times of application of each graph are given by {st} and in our case 
this sequence increases sufficiently fast to permit a strong reduction of the 
number of generated words. 
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3.2 Combination of two graphs: A second example with a 
fully connected graph 

For this second example we take as graph Gi the complete graph on three 
letters i.e., the graph: 




Clearly this graph has no absorbing states. Its adjacency matrix is 



Ml 



1 1 1 
1 1 1 
1 1 1 



and we immediately have 



u:^{X, X) = co^{X, Y) = u^X, Z) = 
coUY^X) =u^{Y,Z) =u^{Y,Y) = 
(Z, X) = u^{Z, Y) = LO^{Z, Z) = 3"-2 

We remark that M[ = S^-^Mi. 

As second graph we use the graph G2 of the previous example. 

We have the following: 

Theorem 4 For every t> 1 we have 



3S1+S3+-+S2t-1 < ^|2t ^ ^si+S3+-+S2t-l JJ(2s2j + 1). 

1=1 

Proof- We begin by computing M^^~''^M|^. First we have the following: 



2S2 + 1 1' 
2S2 + 1 1 
2S2 + 1 1 



Thus, we obtain the inequalities 

Ml < MiM|2 < (2s2 + l)Mi. 
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Hence, we easily get 
and, by induction. 

So we have 

\Ml'-^M^^Ml^ ■ ■ ■ M|2*| = up* > 3si+«3+-+s2t-i_ 

To prove the other inequahty, we see that 

Mf-^Mf < 3*i"^(2s2 + l)Mi 
and, again by induction. 



thus 



t 

i=l 



t 



Ml'-^M^^Ml^ ■ ■ ■ * = cjp* < 3^i+«3+-+s2t-i J JJ(2s2i + 1) 

i=l 

QED 

Choosing now the sequence {sf} as in the previous example, we remark 
that S2t = {t + 1)^ -t^ + t^-{t + 1)2 < 4(i + 1)3. 
Thus we have: 



JJ(2S2^ + 1) < l[{Ss2i) < 12* + If = 

1=1 i=l i=l 

„/(t+l)Ks_ 12«^,, „,,3 



By using Stirling's formula we obtain for the upper bound f2{n) of o;^ the 
relation 

/2(n) X -^^3V"+3/4-^lognlog3_ 
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For the lower bound /i(n) of ufj: we have 

A(n)=3v^. 



The choice of the graphs is obviously crucial for getting this result. 
Clearly, by combining graphs each of which produces an exponential growth 
rate, we cannot obtain a growth rate given by a stretched exponential. The 
two examples presented herein permit to compute analytically the bounds 
for the number of words generated by their combination. In general one can 
realistically expect only an estimation obtained by numerical simulation. 
Furthermore, the choice of the sequence {st} has been carefully made, in 
order to have the graph with the polynomial growth rate acting for a longer 
time. By combining more than two graphs one has much more freedom in 
the choice of the controlling sequence. 



4 Conclusions and Outlook 

We have investigated the growth rate of the number of all possible paths in a 
graph with respect to their length in an exact analytical way. By combining 
two or more graphs over the same alphabet, in order to obtain a discrete dy- 
namical system generated by a triangular map, we were able to demonstrate 
stretched exponential growth of the resulting symbol-sequences with respect 
to their length. The combination of two graphs may be interpreted as the 
driving of one system by another through parametric perturbations. In this 
view a sub-exponential growth rate indicates 'persistent memory effects'. 

In most cases persistent memory makes any finite graph description only 
approximate as in the case of zero Kolmogorov-Sinai entropy systems. The 
best studied example is that of the Fibonacci system, and the binary (coarse 



grained) representation of the circle-map Berthe, 1994 , where the 'mem- 
ory effect' in the language of dynamical systems excludes any simple graph 
generating mechanism. Indeed, symbol sequence of the Fibonacci system 
can only afford a description by an infinite^ but countable, family (the 
leaves of a rooted tree) of Rauzy graphs, see for example [Casaigne, 1997| , 
[Dekking, 1992], [ Dekking, 1982| . Scaling behavior of entropy estimates and 
compressibility issues of such systems with their well known oc log{n) behav- 
ior, have been extensively studied [Queffelec, 1987| , [Schurman, 2002| , in a 
non-probabilistic framework. A combination of graphs might also be useful 



17 



in this context. It might account for another description of such systems 
with 'long memory'. 

The two examples presented here are part of a wide class which can 
produce stretched exponential growth. Indeed, it is clear that by combining 
more graphs, some of them with polynomial rate of growth of the number of 
words, we gain in degrees of freedom in the choice of the controlling sequence 
{gt} and thus in lowering the number of admissible words. It should be noted 
that in general a subword of an admissible word generated by a combination 
of graphs is not an admissible word. This contrasts with the case of a single 
graph and may be thought as a "mark" of this type of construction. It is 
only a matter of direct observation to realize that in natural languages, too, 
a subword is not, in general, a word of the language. 

Although a great deal of attention has been devoted to the scaling laws 
associated with the growth of networks, attention on the dynamical basis 
of the generator of networks from a dynamical systems' point of view has 
been reported only quite recently [Nicolis et al, 2005] . Now, since the edges 
of G, connecting two states/letters of the alphabet can be labeled by these 
states: i.e. the edge from i to j has the label "if\ then from the list of 
all edges of G we can construct another graph G^^^ having the edges of G 
as its vertices. This way we can designate the 3-path "ijfc" describing the 
transition i ^ j ^ k, as an edge from ij jk. We label this edge from vertex 
ij of G^^-* to the vertex jk of G^^^ as the edge ij{j)k = "ijk" of G^^-* . One can 
continue in this way produce higher order graphs from the original graph. 
The study of the growth of block entropy of the original sequence, i.e. the 
proliferation law of words of length n can then be performed by studying 
the growth of the associated higher order graphs of G. The same argument 
goes for the Markov chains associated with G and its associated measures, 
if we are interested not in the possible transitions but rather in the probable 
ones. Our work opens therefore the perspective that a link between the 
concepts of block entropy and network growth. The key observation here is 
that by a combination of graphs, the necessary increase of the number of 
non admissible words, for example via suitable "super-selection rules" as in 
Nicolis, 2005| , is achieved to such a degree that leads to the establishment 
of a stretched exponential growth rates. This sub-exponential growth is not 
due to a limited sample or system size but can be thought of as integral 
part of the topological description of the system. The presence of specific 
constraints, super-selection rules or parameter forcing might play exactly 
this role in a more realistic modeling of chaotic or stochastic systems. 
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